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1 . BACKGROUND 



This paper introduces some models for pairs of dependent exponential 
random variables constructed as random-coefficient linear functions of pairs 
of independent exponential random variables. The transformations used 
occurred first in connection with time series models in exponential variables 
(see Lawrance and Lewis [1981] for details of this work). These models 
indicate that a specific random-coefficient linear function of independent 
exponential variables leads to further univariate and multivariate exponen- 
tial variables, somewhat analogously to linear functions of independent 
Gaussian variables leading to further univariate and multivariate Gaussian 
variables. Negative exponentiation of the transformation then leads directly 
to a random-power multiplicative transformation, and it is found that this 
can similarly be employed in constructing pairs of dependent uniform random 
variables from pairs of independent uniform variables. Both transformations 
are particularly suited to simulation work, the pairwise uniform giving a 
base from which to transform to many other bivariate distributions. 

This paper then presents results on both dependent exponential pairs 
and dependent uniform pairs. The transformations used are necessarily 
limited to situations of positive dependency, but broadening to negative 
dependency is achieved by employing simple antithetic operations in the 
constructions. The distributions given are free from point and linear con- 
centrations of probability. If these are required, as is sometimes the case 
in reliability studies, the concentrations of probability can be put in by 
using mixtures. 

There are, of course, many earlier bivariate exponential and uniform 
distributions; for instance, the work of Marshall and Olkin [1967] which 
involves choosing the minimum of two exponentials, and which can easily be 
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simulated, but which always has a line-concentration of probability. Downton 
[1970] and Hawkes [1972] developed bivariate exponentials employing the idea 
of bivariate geometric compounding of independent exponentials; in simulation 
this would require simulation of bivariate geometries. Gaver [1972] proposed 
a bivariate exponential specifically for negative dependency, also allowed 
in Hawkes' extension, and which in simulation would need both the operations 
of choosing minima and ordinary geometric compounding; further, it is 
intrinsically non-reversible, unlike most bivariate exponential models. 

Other types of bivariate exponentials could clearly be obtained via the 
inverse probability-integral transform of other standard bivariate distribu- 
tions; bivariate uniforms in this category are specifically considered by 
Barnett [1980]. All these methods involve a fair amount of complication, 
particularly the inverse probability integral transform, and limited flexi- 
bility. The methods proposed in this paper seem simpler than all previous 
methods at least in the major respect that each bivariate dependent pair is 
obtained by simple random-coefficient linear transformation of a correspond- 
ing independent pair; furthermore they are flexible in their dependency 
properties, and easy to simulate. 

In summary, unless very specific modelling or structural detail is 
required, e.g. the linear regression of Downton's model, the present models 
offer the following advantages: 

(i) The constructions are very simple. 

(ii) They require only two independent exponential random variables 
and one or two binary random variables for their construction, 

(iii) There is a broad range of the attainable dependency, as measured 
linearly by the product-moment correlation or monotonical ly by 
the Spearman correlation. 
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(iv) The models are analytically tractable so that, in some cases, 

closed form joint probability density functions and regressions 
can be obtained. 

The scheme of the following sections of the paper is to examine the 
properties of the very simplest, one parameter, models (EPl and UPl ) in 
detail. The properties include product-moment and Spearman-type correla- 
tions, joint probability functions and regressions. These models have a 
broad but, positive correlation range which is then extended to negative 
correlation by using antithetic pairs. In later sections models with more 
parameters which can attain correlations right up to the theoretical bounds 
are introduced, but developed in less detail. The most general of these, 
the EP+ and EP- models, allow the complete range of possible correlations 
for bivariate exponential pairs and the possibility of accommodating other 
structural details; they include all the other exponential models. Parallel 
development is given for bivariate uniform pairs. 
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2. ONE PARAMETER POSITIVELY DEPENDENT EXPONENTIAL MODEL: EPl MODEL 

The random coefficient linear function referred to in Section 1 is 
central to this work and is presented first. Let a pair of independent, 
identically and exponentially distributed random variables be denoted by 
(E^, E^); for simplicity, unit means are assumed throughout. Let I be 
a binary random variable, independent of (E^, E 2 ), with distribution given 
by P(I = 0) = 3 , P(I = 1) = 1 - 3 . Then the random variable X , given 
by 

X = 3E^ + E 2 , (2.1) 

has an exponential distribution with unit mean; this can be seen by taking 
moment generating transforms, 

<{.x(t) = E{exp(-tX)> = {3 + (1-3) ^ (2.2) 

The result can be extended by taking E 2 to be a random-coefficient linear 
function of a further pair of exponential random variables independent of 
E^ . However, (2.1) is all that is required here to construct bivariate 
pairs of exponential random variables; the result ( 2 . 1 ) is implicit in the 
construction of exponential time series models evolving out of the EAR(l) 
model of Gaver and Lewis [1980]. 

The EPl Model 

The first and simplest bivariate exponential distribution of the paper 
is obtained by interchanging E-j and E 2 in ( 2 . 1 ) to give the second 
member of a pair, and hence produce 
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= 6E^ + ^2 , 



(2.3) 



(EPl) 

These will be called the EPl(B) pair; the pair is clearly dependent because 
of the conmon E 2 and I . There are clear generalizations obtained by 
using different 3's and I's for X.| and which will be considered later. 

The dependence of (X^ X 2 ) can be assessed by their (product moment) 
correlation coefficient as 

Corr(X^, X 2 ) = E{(BE^ + IE 2 )(gE 2 + lE^ )} - E(6E^ + IE2)E(3E2 + lE^ ) 

= 33(1-3) , (2.4) 

which is sketched in Figure 1. The correlation thus has the non-negative 
range (0, 0.75) with maximum value 0.75 at 3 = 0.5 and symmetry about 
3 = 0.5. The product moment correlation emphasizes linear dependency, 
taking maximal values of + 1 if and only if the variables are linearly 
related which is not the case here; a more general and more appropriate 
measure of non-linear dependency, Spearman's correlation, will be considered 
in Section 3. 
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Figure 1. Correlation functions for the EP1(3) model 
and the UP1(3) model as functions of 3 ; both models 
exhibit only positive dependence. 

The joint probability density of X-j and X 2 can be obtained by 
considering the probability element for X-j and X 2 in terms of 3 E-j + IE 2 

and 3 E 2 + IE.| . On letting I take its values 1 and 0 with probabilities 
1-3 and 3 this becomes 

(1-3)P{(3E, + E 2 ) x^ + dx^), ( 3 E 2 + E^) + dx 2 )> 

(2.5) 

+ 3P{3E-| €(xp X.J + dx^}P{3E2 ^(x2, X 2 + dX2)) . 

The first line of (2.5) can be expressed as a probability element statement 
in terms of E.j and E 2 separately, and using the Jacobian, (1-3^). of 
the transformation from E-j and E 2 leads to the joint pdf of 
X-| and X 2 as 
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( 2 . 6 ) 



X.| ,X2(x.| ,X2) “ (l“3)l(x.| > 3 X 2 > X 2 (x2”3x.|) 






where 1( ) is an indicator function taking the value 1 if x.| > 3 X 2 and 
^2 > 3x.| and 0 otherwise, and f denotes the density of the exponential 
variable in its suffix. Simplifying (2.6) then gives the desired result 



fx X (x-|»X2) = 1 ( 3 x 2 < x.| < 3 ^X2)(1+3)'^ exp{-(x.|+X2)/(l+3) 1 



(2.7) 



+ 6"^ exp{-(x.|+X2)/3} , 0 < 3 £ 1 ; x., ,X 2 > 0 



The joint density thus has a wedge shaped sector of relatively high density 
( 3 X 2 < x.| < 3 ^X 2 ) superimposed over an independent bivariate exponential 
density. This function is isometrical ly plotted in Figure 2 for 3 = 0.5. 
For low values of 3 the raised section spreads out over the quadrant and 




Figure 2. Isometric plot of the joint probability density 
function of the positively dependent EP(3) model for 3 = 0.5. 

This value of 3 gives the maximum attainable correlation of 0.75; 
the figure has been truncated for both variables at 0.5. 
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leads to independence at B = 0; for high values of 3 the raised section 
diminishes towards nothing and again gives independence at 3=1. 



This joint density function could be used to obtain a maximum likelihood 
estimate of 3 from a bivariate sample; note that a unique moment estimator 
can not be obtained from the correlation (2.2). 

The joint moment generating function of the (X-|,X 2 ) pair, <})^ ^ (t-|,t 2 ), is 
easily obtained via the EPl defining equation (2.3); thus 






X^,X2 



(tpt2) = E{exp(-tiX-| - t2X2)} 

= E{exp[-(3t^ + It 2 )E^ - (3t2 + It^)E 2 ]> 

= 3(1 + 3t.| ) ^ ( 1 + 3t2) ^ 

+ (1-3)(1 + 3t^ + t2)"^(l + t^ + 3t2)"^ 



( 2 . 8 ) 



Differentiating with respect to t 2 at t 2 = 0 and inverting with respect to 
t.| allows the regression of on X^j to be obtained as 

E(X 2 |X.| = x) = 3x + 3 + 1 - (1 + x/3)exp{-(3"^ - l)x} . (2.9) 



This conditional expectation will be fairly linear except for small x , and 
the asymptotic conditional variance will be linear for large x . Note from 
the joint moment generating function (2.8) that the pair (X-|,X 2 ) is reversible, 
4)X X (t-|,t 2 ) = particular, E(X.j|X 2 = x) = E(X 2 |X^ = x) . 

An aspect of this reversibility is that P{X 2 > X^j} = 0.5 which can be shown 
directly from the definition (2.3). 



8 



3. THE NEGATIVE EXPONENTIAL TRANSFORMATION TO UNIFORMITY: UPl MODEL 

It is well known that for an exponential random variable X of unit 
-X -X 

mean, both e and 1-e are uniform random variables, distributed over 
(0,1). These results are of double interest here. Firstly, application of 
the transform to both components of a dependent exponential pair will lead 
to a pair of dependent uniforms, and secondly, which may be more important 
to stress, the product-moment correlation in this pair of uniforms is a 
population analogue of Spearman's rank correlation for the original dependent 
exponential pair. This was demonstrated generally by Kruskal [1958]; he 
showed that the product-moment correlation in the transformed pair of 
dependent uniforms, could be linearly related to the concordance (quadrant) 
probability 



P{X^ - X2)(Y^ - Y3) > 0} , 

where (X^,Y^.: i = 1,2,3) are three independent pairs with the untransformed 

bivariate distribution. Estimation of this probability was based on con- 
structing the empirical joint distribution of an observed sample, and led 
Kruskal to estimating the required linear function of the concordance prob- 
ability by Spearman's correlation. Thus, we have the useful idea that 
product-moment correlation in a bivariate distribution after its transforma- 
tion to uniform marginals represents a population analogue of Spearman's 
correlation for the untransformed bivariate distribution. As such, it is a 
suitable measure of monotonic dependency for a bivariate distribution. In 
particular, the Spearman correlation is a suitable measure for dependency in 
bivariate non-Gaussian distributions because of their intrinsic non-linearity, 
and the consequent limitations of the product moment correlation. 
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General Results for the Transformation 



In the case of an exponential pair (X-|,X 2 ) of unit means, the preferred 
transformation to a uniform pair is given by 



= 1 - exp(-X^), Y^ = 1 - exp(-X 2 ) . 



(3.1) 



The correlation and regression for this pair are easily obtained from the 
joint moment generating function, (j)^ ^ (t^,t 2 ) = E{exp(-t^Xi - t 2 X 2 )> 

of (X-|,X 2 ) . First for the correlation we have 

EIY^Y^} = E{(l-exp(-X^)(l-exp(-X 2 )} = ^X 2 ^^ ^ 



and thus the correlation result 



Corr(Y^,Y2) = 12^)^^ ^^^(1 ,1 ) - 3 . 



(3.3) 



For the regression of Y^ on Y^ , first write it in terms of X.j and X 2 as 

E(Yi|Y 2 = y) = E{l-exp(-X^)|X 2 = - log(l-y)} . (3.4) 

Now setting x = - log(l-y) and denoting the conditional p.d.f. of X-j|X 2 
by f^ (x^|x) , the regression is 

c» 

E[Y^|Y 2 = l-exp(-x)] = / [l-exp(-Xi)]f^ (x^|x)dx^ . (3.5) 

X ^ “0 12 

The required result is obtained after multiplying both sides by exp(-tx) 
and integrating x over (0,<»), so leading to 

“ -1 

/ exp(-tx)E[Y I Y = 1 - exp(-x)]dx = t - (f)y y (l,t-l) . (3.6) 

0 ' ^ n ’-^2 
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Thus, the regression of the uniforms follov/s from inverting the joint moment 
generating <t>Xi ,X 2 ^^ ^ exponential pair with respect to t as a 

function of x , and then replacing x by - log(l-y) . 

The UPl Model 

The negative exponential transformation to uniformity is now exemplified 
using the EP1(3) model. To obtain a pair of independent uniform random 
variables from a pair of independent exponentials it is simplest here to use 
the monotonic decreasing version of (3.1), that is 

= exp(-E^) , U 2 = exp(-E 2 ) . (3.7) 

It follows then that the dependent uniform pair derived from the EP1(3) 
exponential model via (3.1) is given by 

(UPl) = 1-U^ U 2 , Y 2 = 1-uj , (3.8) 

where I retains its definition from Section 2. The random power multipli- 
cative aspect of the model is evident. The pair (Y.j ,Y 2 ) of (3.8) will be 
termed the UPl (3) model; the correlation of this uniform pair follows imme- 
diately from the joint moment generating function of (X-|,X 2 ) as given at 
(2.8), or by direct calculation, and is 

Corr(Yi ,yJ = 33(1-3) 8+73+^ _ ( 3 _g) 

' ^ (1+3)M2+B)^ 

This function of 3 is illustrated in Figure 1; its maximum value is 0.72 
for 3 = 0.32. The joint density of Y-j and Y 2 may be obtained by considering 
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(3.10) 



P(Ui ^l±yy 4 

“ 3P(U^ •— ^ 2 ^ (^“3)P(U^ ^ 2 . ~ ^1 ^2— ^ 2 } ‘ 

Density for the last probability is restricted to the leaf shaped region 
(y^^^ £ y-| £y 2 » 0 ±)/ 2 — final result takes the form 



fy V ' '(y2^®iyi < y|KU6)‘'(y,y2)'®''<'^®' + B'\y,y2)*''®’'® 

(3.11) 

(0 £-y^ ,Y 2 1 1 ; 0 < 3 < 1 ) . 



The density is isometrically plotted in Figure 3 for 3 = 0.32, the value 
giving maximum product moment correlation. 




Figure 3. Isometric plot of the joint probability density 
function of the positively dependent DPI ( 3 ) model for 3 = 0.32 . 
This value of 3 gives the maximum attainable correlation of 0.75. 



\ 
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Regression for the DPI model is most easily obtained via (3.6) using 
the joint moment generating function of X-j and given at (2.8) and takes 
the form 

E(Y2|Y^ = y) 

= 1 - (l+6)'\l-y)^^'^^/^ + (2+3)“^l-y)^^-^)/^ - (2+B)'^l-y)^ . (3.1 

The regression has initial value 3/(1 -B) which is always less than 0.5 and 
curves upwards towards 1.0 in a near monotonic concave way. For 3=0 and 
3=1 it has the value 1/2 which is correct since Y 2 and Y-j are then 
independent and E(Y 2 ) = 1/2. Note that the UPl pair is, like the EPl pair, 
reversible, in particular E(Y 2 |Y.| = y) = E(Y||Y 2 = y) . Also 
P{U.| > U 2 } = 0.5; this can be seen directly from the definition (3.8). 



13 



4. NEGATIVE DEPENDENCY USING AN ANTITHETIC APPROACH: EP2, UP2 MODELS 

The antithetic transformation of any random variable X is found by 
first expressing it as a function (the inverse probability integral) of a 
uniform (0,1) variable U , and then by taking the same function of 1-U. For 
any nonnegative random variable X , the antithetically transformed variable 
a(X) has the same marginal distribution as X and is maximally negatively 
correlated with X ; note that the Spearman correlation of X and a(X) is 
minus one, but their product moment correlation will not necessarily be as 
negative as this. In the exponential case, 

a(X) = - logd-exp(-X)) (4.1) 

and the maximum negative product moment correlation is - 0.6449, as is well 
known after Moran [19673. As a pair of exponential random variables, X and 
a(X) lie on the curve 



e 



-X 



+ e 



-a(x) 



= 1 



and so are highly degenerate in the sense that X completely determines a(X) 



The EP2 Model 

The aim here is to construct negatively dependent exponential pairs 
which are not, like the antithetic pair, partially or completely degenerate; 
the random-coefficient linear transformation (2.1) allows us to do this while 
still making use of antithetic pairs. The general approach is illustrated 
with respect to the EPl model; in (2.3) the E.| and £2 o'*" ^2 replaced by 
their antithetic versions a(E.|), a(E 2 ), and I in X.| and X 2 is replaced by 
I.J and I 2 respectively, these variables having the same marginal distribution 
as I . Thus the suggested negatively dependent model has the form 
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(EP2) 



(4.2) 



X2 = 6a(E2) + I 2 a(E^) , 



and the expression for its correlation is given by 



Corr(X^,X2) = 2B(1-0) (-0.6449) + Cov(Ipl2) . 



(4.3) 



This suggests that maximum negative correlation of X.j and X 2 requires 
maximum negative covariance of I-| and I 2 . For fixed 6 > this will be 
achieved for minimum E( I.j , 12 )’ equivalently minimum p = P(I-| =1, I 2 = 1) . 
Consideration of the general joint distribution of I-| , I.;,, that is 



shows that, since the probabilities must be non-negative, the (0,0) term 
constrains p to the minimum value of 1-23 if 3 _< and 0 if 3 ^ ^ . The 
implied joint distribution is, not surprisingly, the antithetic one, and it 
has covariance - 3^ for 0 _< 3 < ^ and -(1-3)^ for ^ £ 3 £ 1 . Thus, going 
back to (4.2), the model with = I, I 2 = a(I) is of most interest in 
connection with negative dependence and will be called the EP2(3) model; its 
correlation is given by 



0 



I 2 = 1 p 1-B-p 1-3 

0 1-3-p 23 -l+p 3 



(4.4) 



1-3 



3 



-23(l-3)(0.6449) - 3^ 



0 < B <h , 



Corr(X.| ,X 2 ) = ^ 



(4.5) 



-23(l-3)(0. 6449) - (1-3)' Js £ 3 £ 1 . 
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This function is sketched in Figure 4. The minimum value is -0.5724 at 
3 = 0.5 which, considering the model is never degenerate, is fairly satis- 
factory. (The Gaver model [Gaver, 1972] is also not degenerate and has a 




Figure 4. Correlation functions for the EP2(3) model 
and the UP2(3) model as functions of 3; both models 
exhibit negative dependence. 

minimum correlation of -0.5). A simulation of EP2(3) pairs at the 3 = 0.5 
value is given in Figure 5; the scatter is best described as a non-degenerate 
emulation of the antithetic concentration along the curve e + e = 1 . 

Weakening of the dependency as the parameter 3 approaches 0 or 1 fades 
this characteristic scatter into the blander independent exponential picture. 
The scatter in Figure 5 should be compared to the isometric plot of the joint 
density in Figure 3. 

The joint moment generating function of X-j and requires the joint 
moment generating function of E^- and a(E^) which is straightforwardly 
evaluated as 
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Figure 5. Scatter plot of 50 simulated pairs of observations 
from the negatively dependent EP2(3) model for B = 0.5: the solid 

line represents the curve relating the antithetic bivariate 
exponential pairs. 



1 t, t^ 

,t 2 ) = / X (1-x) "^dx , (4.6) 

0 

which is the Beta function B(1 + t-j , 1 + t 2 ) . Also required is the joint 

distribution p.. = P{I = i, a(I) = j}, i, j = 1,0, available as remarked 
* u 

previously following (4.4) ; hence the result, via (4.2), 

,X2^^1 ’^2^ 

“ P"l 1 Bt-j , t2 ) •!>( t-| , Bt2 ) ^ P"! g4*( 3t-j , t2 ) ( 1 ^■Bt2 ) (4.7) 

PqI 4*( I"! 5 St2) ( 1 "^Bti ) ^OO^^^^^l^ (l'^Bt2) 
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Actually the model (4.2) works for any independent bivariate exponential 

I I 

pairs (E^,E-j) and ' however, the antithetic pair is simplest to 

generate and gives the greatest negative correlation in the (XpX 2 ) pair. 

The UP2 Model 

Thus far we have the EP2 model giving a broad range of negative depen- 
dency for exponential pairs; this is now transformed to the corresponding 
uniform pair giving the UP2 model. By negative exponentiation of (4.2) and 
use of (3.1) and (3.6) we have 

(UP2) ''1 ' ' - = 1 - (1-U, )«(')(, ,u^)6 (4 5, 



The correlation of Y-j and Y 2 may be evaluated directly from (4.8) or by use 
of (4.7) and (3.3) and gives the result 



Corr(Y^,Y2) = 



^ -36(4+56+63^+6^)/[(1+3)^(2+3)^] 
. -3(1-6)(2+36-3")/[(1+3)"(2+6)] 



0 < 3 < % , 

< 3 < 1 . 



(4.9) 



A graph of this correlation function is given in Figure 2; its maximum 
negative value is -13/15 = -0.8667 which occurs at 3 = 0.5; this indicates for 
the EP2 model a good negative range to the Spearman correlation, but no 
ultimate degeneracy. Bivariate scatters from the UP2 model show a strong 
degree of linearity compared to the near antithetically curved scatter of 
the corresponding exponential EP(2) pair in Figure 5. Again, the asymmetry of 
the dependency about 3 = 0.5 in the EP2 model is more evident from the 
Spearman correlation of the UP2 model. Negative dependency is considerably 
stronger for 3 = 0.5 - 6 than the corresponding 3 = 0.5 + 6 . This parallels 
the EPl model in which positive dependency is stronger for 3 = 0.5 - 6 than 
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for 3 = 0.5 + 6 ; these remarks are borne out in scatters for various values 
of 3 • Finally, it should be noted that the antithetic choice (I,a(I)) is 
best in regard to obtaining negative dependency in the UP2 model, as was found 
for the EP2 model. Regressions are again not easily tractable. 

Positive and Negative Dependence 

Extension of the bivariate models given above to models which exhibit 
both positive and negative product-moment correlation is achieved quite 
simply by mixture arguments. For example, combining (2.3) and (4.2) let 

X-| = 3E-| + I-jE^ 



3 E 2 + I-| E^ 


w. p. 


p > 


3a(E2) + l2a(E] ) 


w. p. 


1-p . 



This uses the fact that a probability mixture of two identically distributed 
random variables (possibly dependent) has that same identical distribution. 
These two parameter model contains both the EPl model (p = 1) and the EP2 
model (p = 0) and has product moment correlation ranging between -0.5724 
and 0.75. 
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5. TWO PARAMETER VERSIONS OF THE MODELS: EP3, UPS, EP4, UP4 MODELS 

Dependency in the models has thus far been determined by one parameter 
6 , but it may be desirable to have an additional parameter in the model so 
that two aspects of the joint distribution can be modelled; for instance, 
one dependency measure, such as the product-moment correlation, and a prob- 
ability statement, such as P(X-| > X2), which in the EPl model was equal to 
0.5 for all 3 . Two approaches will be discussed rather briefly. One 
allows B in the randomly linear combination of E-j and E2 to be replaced 
by B-j for X-j and fo*" ^2 ’ while in Section 6 a two parameter randomly- 
1 inear operation is used: this stems from the NEAR(l) model of Lawrance 

[1980], Lawrance and Lewis [1981]. 

The EPS Model 

The first two parameter model, EPS, is defined by the equations 



X 

II 


^1 




ii E 2 , 


0 


< B^ 1 1 , 


II 

CM 

X 






UJ 

CM 

1— 1 


0 


£ B 2 1 1 • 



The marginal distributions of I-j and I2 must correspond to the different 
B parameters so that P{I.| = 0} = 1 - P{I.| = 1} = B-| and 
P{l2 = 0} = 1 - P{l2 = 1 } = B2 • The product moment correlation of the 
model is given by 

Corr(XpX2) = B^(l-32) + B2O-31) + Cov(I^,l2) • (5.2) 

The general joint distribution for (I-|,l2) is the obvious generalization of 
(4.4); the value of p-ji for maximum positive dependence is now min( 1-B-| ,1 -B2) • 
Hence the result 



20 



Corr(X-| ,X2) 



'2B-|(1-62) + 

31O-B2) + 262(1-3^) 



0 1 3 -| 1 ^2 1 1 ’ 

0 < 62 1 3 ^ 1 1 • 



Contours of this function (Figure 6) show a central region with a local 
maximum of 0 . 75 ; the function decreasing from each side of the centre along 
the line 3-| = 32 to zero values at the corners where 3-| = 32 = 0 and 

3l = ^2 “ 1 , and the function increasing from each side of the centre along 

the line 3 -| + B2 = 1 to unit values at the other two corners. The joint 

density of X-j 5X2 is simply obtainable but is now a mixture of three, 

instead of two, components. Thus maximum likelihood estimates of B-| and B2 
can be obtained. 




Figure 6. Correlation function of the two-parameter positively 
dependent EP 3 (B-| .B2) model: unlabelled contours may be identified 
from their joins wTth the B-| and B2 axes. 



21 



The edges ( 3 -| = 0) or (62 “ 0) 9 ive a one-parameter bivariate exponen- 
tial pair which corresponds to adjacent (exponential) variables in an 
EAR(l) process [Gaver and Lewis, 1980]. Note that using the basic relation- 
ship ( 2 . 1 ) outside of the serial constraint posed by a time series gives a 
broader bivariate exponential pair. 



The UP3 Model 

The corresponding uniform model, UP3, is given by 

$1 I-i Ip ^2 

(UP3) = 1 - 'U 2 ', Y 2 = 1 - (5.4) 

and has correlation (the Spearman correlation of the EP3 model), given by 



Corr(Y^,Y2) = 12 



1-B, 



82-Bi 



( 2 +B-| ) (1+82) ^ (2+B2) ( 1 +B-| ) 



(5.5) 






- 3 



(0 < 6 ^ < 



$2 < 1 ) 



For 3-| ^ B 2 there is a symmetrical result. The contours of this function 
represent a deformation of those just described for the EP3 model, symmetry 
about = ^2 ''s preserved, while the area of local maximum is moved 

towards the origin. Thus, asynmetry in the Spearman dependence is indicated. 



The EP4 Model 

The negatively dependent version of the EPS model is the two parameter 
version of (4.2), and will be called the EP4 model; this has correlation 
function 
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Corr(X^,X2) = - 0.6449[3^ (1-32) + 62^-61)^ 



^1^2 


for 


^1 


+ 32 £ 


(1-3^)(1-32) 


for 


^1 


^2 — 



Contours of this function indicate a valley of lov/est negative values along 
the direction B-| + B 2 = 1 » wth a central value of -0.5720 and corner values 
of maximum negativity, -0,6449. For specified negative correlation dov/n to 
about -0,5 there is a wide choice of (B-|»B 2 ) pairs, in the two regions either 
side of the valley along 6-j + ^2 " ^ • 



The UP4 Node! 

The final development of the two parameter models is to the negatively 
dependent two parameter uniform model, the UP4 model. This corresponds to 
(4.8) with B and I in Y-j replaced by B-| and I-j and 3 and I in 
Y2 replaced by 32 and a(l2) . Maximum negativity of dependence follows 
from the 'antithetic' joint distribution for I-j and which has 
P-J1 =1 - (3-|+32) when 3-| + B2 £ i and p^^ = 3.| + 32 - 1 when 
3-| + 32 ^ 1 • We then have, for the case B-| + 32 £ i > 



Corr(Ui ,112) = 12 



1 - (B1+32) B-| 

(1+3t)(2+3i)( 1+B2H2+B2) d+B^ ) (1+32) (2+3^ ) 



(l+3-| ) (1+32) (2+32) 



(5.7) 



- 3 . 



The corresponding result for B-| + 32 £ 1 Is omitted. The contours of this 
function are quite similar to those of the EP4 model, but with a central 
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value of -0.867 and associated corner values of minus one; the other two 
corner values are zero, as for the EP4 model; it is again useful to view 
these as the Spearman correlations of the EP4 model. 

From the point of view of simulation, the two parameter models are 
hardly more complicated than the one parameter version and offer an extra 
degree of flexibility. The joint probability density functions and moment 
generating functions are more complicated than for the one parameter models, 
but can be derived if needed, for instance, for estimation. It is also 
possible to derive measures such as P{X-| > X 2 > , which is not necessarily 
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6. MORE GENERAL FOUR PARAMETER MODELS: EP+, EP-MODELS 

The NEAR(l) exponential time series models of Lawrance and Lewis [1981] 
suggests a class of four-parameter models; these are likely to be over- 
complicated for ordinary use, but place the earlier models in a general 
setting and suggest a further class of two-parameter models. They also give 
a bivariate exponential pair with full positive correlation, and without the 
degeneracy which occurs for the case (6.| = 0 or 82 “ 0) the EPS model. 
Being as brief as possible, this development gives the EP+ model as 



(EP+) 



where, for i = 1,2, 



n w.p. a. 






0 w.p. 1-a- 



Xi + I^E2 , 

( 6 . 1 ) 

^2 ~ 62^2^2 ^2^1 ’ 



1 w.p. (l-3^-)/[l-(l-ai)6^.] 
(l-ot^.)3.j w.p. a.3.j/[l-(l-a.j )3.j] 



and the random variables (VpV2), (I-|,l2) ane independent between pairs but 
usually dependent within pairs. This model has correlation structure of 
the form 



Corr(X^,X2) = 3^32 Cov(V^ ,V2) + Cov(I^,l2) 

( 6 . 2 ) 

^ ®^1 3i ( 1 ~ct232 ) oi232("^ ~^1 ^1 ^ " 

For a model of maximum positive dependency the appropriate joint distributions 
of (V-|,V2) and (I.|,l2) could be obtained using constructions as at (4.4). 

A further two parameter model, EP5, is suggested by taking a.| = a2 = a , 
3-| = 32 = 3 and V.j = "" ^2 ’ reduces to 
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(6.3) 



Corr(X.|,X2) = 3ag(l-a6) . 



This has maximum value 0.75 at aB = 0.5 , but does not attain the higher 
correlations of the EPS model, and is more complicated in its construction. 

Both the EPl and EPS models can be obtained as special cases of the 
EP+ model; the EPl model is given by taking a.j = a2 = 1 and B.j = ^2 = 6 
with I.| = I2 , while the EPS model has a.j = a2 = 1 , (3-1,62) unchanged, and 
with (I.|,l2) of maximum possible dependency. 

Corresponding to (6.1) there is a more general negatively dependent 
four-parameter model, EP-, of the form 



Xi = . I^E2 , 

X 2 = B-|V^a(E2) + l2a(E^) , 



(6.4) 



which has, by analogy, the correlation structure 



Corr(X.| ,X2) = B-| B2Cov(V.| ,V2) + Cov(I.|,l2) 

- 0 . 6449 [a.| B-] ( 1 -01262) ^1 ‘ 



(6.5) 



It contains the EP2 and EP4 models, and would suggest the further two param- 
eter model, EPS, by taking a.j = a2 = a, B-| = B2 = 3 and (V.|,V2), (I.|,l2) 
as two antithetic pairs. 

Any further details are omitted, as are the corresponding uniform models 
of the four-parameter class, L)P■^, UP- given in Table 1, which summarizes all 
the models. 
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7. MULTIVARIATE GENERALIZATIONS 

The possibility of multivariate generalizations is apparent by repeated 
use of the random-coefficient linear functions of (2.1). In fact this is 
the way the EAR(l) process is constructed with a serial chaining of i.i.d. 
exponentials Ep E2,.... Any k variables in an EAR(l) process (or an 
NEAR(l) process) are a k-variate exponential random variable. Outside of 
this serial context many possibilities suggest themselves. Thus changing 
3 to B-| , I to I-| and replacing E2 by a similar random-coefficient 
linear function of independent E2 and E^ using $2 and I2 , gives 

X = 3-jE^ + ^2^1^2 ^ ^1^2^3 ‘ (7.1) 

Here I-| and I2 must be independent. A triple of dependent exponential 
variables could be constructed using Ep E2> in three of the six 

possible orders. 

A simpler possibility would be to use the basic randomly-1 inear 
operation on the pairs (EpE2) , (E2»E2) and (E^jE-j) . Such developments 
are not considered here. The possibilities are legion but no 'natural' 
simple method suggests itself above any other. 
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8. LINE DISCONTINUITIES AND RELIABILITY PROBLEMS 



The problem of discriminating amongst the many bivariate exponential 
models is not simple, although there may be modelling or structural details 
which recommend certain models in certain contexts. Most of these details 
are, however, tenuous and difficult to verify from data. An important 
mathematical scheme is given in Griffiths [1969], who found a canonical 
expansion for bivariate exponential random variables. Again the models put 
forward here are simple to generate on a computer and are analytically 
tractable. 

Another property is that the bivariate distributions do not have line 
discontinuities. However, as an illustration of modelling considerations, 
we note that in a reliability context thus is not necessarily a virtue. It 
is known that components in a system can fail from a common cause, which is 
precisely what gives the line discontinuity in the bivariate distribution. 
However, it is simple to put this in to the present models and it can be 
done in at least three ways. 

Thus, let {X-| ,X 2 ) denote any unit mean, bivariate exponential pair, 
let (I-j,l 2 ) denote an indicator pair, possibly completely or partially 
dependent, with marginal distributions P{I-| = 1} = 1 - P{I-| = 0} = P^ and 
P{l 2 = 1} = 1 - P{l 2 = 0} = P 2 5 and let E be an independent, unit mean 
exponential random variable. Three new bivariate exponential pairs are given 



(i) 


= I^X^ + (l-I^)E , 


Z 2 = I 2 X 2 + (1-I2)E i 


(8.1) 


(ii) 


Z-| = 6E + IiX-| , 


Z 2 = 8E + I 2 X 2 ; 


(8.2) 


and 
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(iii) Z-| = min(XpE) , 1 ,^ = min(X2,E) v 

In all three cases there is a non-zero probability that Z-| and Z^ are 
proportional to E . 

The first pair uses the idea that mixtures of identically distributed 
random variables have that same distribution, the second pair uses the basi 
relationship (2.1) and the third uses the fact that the minimum of independent 
exponential random variables is an exponential random variable. In fact, 
if X-j and are independent, then (8.3) is the Marshal 1-01 kin model. 
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TABLE I 



Summary of Models Considered (See text for relevant details) 



EPl 


= 3E^ + IE 2 
^2 ~ ^^2 ^ ^^1 


UPl 


= 1-U^U^ 
Y 2 = 1-uju^ 


EP2 


X-| = 3E-| + I-|E2 

X 2 = 3a(E2) + l2a(E-|) 


UP2 


Y^ = 1-U^U^ 

Y^ = 1-(1-U^)^^^^(1-U2)^ 


EPS 


Xi = 3^E^ + I^E2 
^2 ~ ^2^2 ^ ^2^1 


UP3 


^1 T 

V, = 

= 1-u, V 


EP4 


Xi = 3^E^ + I^E2 


UP4 


Yi = 1-U^^U2 

1 2 3o 

Y 2 = i-(i-u^) ^( 1 - 02 ) ^ 


EP+ 


X, = 6,V,E, + I,E2 
^2 ~ ^ ^2^1 


UP+ 


^1^1 ^1 
Y^ = 1-U^' 'U 2 ' 

In 3oVp 
Y 2 = 1-U^^U2 


EP- 


Xi = 3^V^E^ + I^E2 

X 2 = 3iV2a(E2) + l2a(E^) 


UP- 


3iVi I, 

Y^ = 1-U/ '(I-U 2 ) ' 

^2 ^1^2 
Y 2 = l-d-U^) ^(l-U2) ' ^ 
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